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An In-Depth Investigation of One School Districts Responses to an 
Externally-Mandated, High-Stakes Testing Program in Minnesota 

Externally-mandated, high-stakes tests affect all aspects of schooling. But, although all aspects of the system 
are affected, most empirical research has concentrated on the impact of these testing programs at the 
classroom-, teacher-, or student-level (Schleisman, 1998). What research has not done, however, is examine 
the structural responses of schools to an externally-mandated, high-stakes testing program (at least not in any 
depth). By structural responses, I mean school-level policies and practices, such as changes in course 
offerings, changes in school-day or school-year organization, or changes in access to remedial help, which 
might include additional schooling opportunities such as after school programs, Saturday school, or summer 
school programs. 

Thus, at the level of school policies and practices, the literature is lacking. Although educators have 
acknowledged that changes to school policies and practices occur as a result of externally-mandated, high- 
stakes testing programs, an in-depth examination of what specifically these changes are has not been 
conducted. This study investigated one school district’s changes in policies and practices (at the school-level 
and district-level) as a result of the implementation of an externally-mandated, high-stakes testing program in 
the state of Minnesota. 



The State Context 

In 1993, the Minnesota state legislature passed a law requiring the State Board of Education and the 
Department of Children, Families, and Learning (DCFL) to develop a results-oriented Graduation Rule. One 
component of the Graduation Rule focuses on basic standards, which define the minimum competency in 
reading, mathematics, and writing that a student must possess before graduating from a Minnesota public high 
school. [Note that the writing assessment will not be considered here, because the writing assessment is not 
administered as part of the MBST and it was initially implemented just last year.] The basic standards are 
measured by the administration of the Minnesota Basic Standards Test (MBST). The MBST is a minimum 
competency, high-stakes test. Students are administered the MBST beginning in 8 th grade, and all students 
must pass the MBST before they can graduate. 

The rhetoric around the adoption of this statewide testing program is that no child will “slip through the cracks.” 
No longer will students be able to earn a high school diploma simply by attending classes for four years, and 
without being able to read, write, and calculate basic math problems. Proponents of this externally-mandated, 
high-stakes testing program in Minnesota claim that the Graduation Rule will insure that every student will 
graduate with a minimum competency of knowledge in three core areas (reading, math, writing). 

For children who have trouble passing the MBST, policymakers claim that “local districts offer a variety of 
services to students who do not pass the tests” (http://www.educ.state.mn.us). Using test scores, educators 
will make changes in order for students to achieve success. Policymakers purport that “the results of these 
tests can help school districts make decisions about what and how they teach” (http://www.educ.state.mn.us). 

Part of the legislation for the Graduation Rule states that the results of the MBST be published, which adds an 
accountability component to the Graduation Rule. Subd. 3 of Statute 121.1113 states that “the commissioner 
shall report test data publicly and to stakeholders” (http://www.educ.state.mn.us). According to information 
provided on the DCFL website, the testing results are used in the following ways: 

They measure the success of schools and districts in improving student achievement over time. 

They generate information for school improvement and accountability. 

They allow for identification of programming and strategies that work. 

They allow for comparison of schools and districts in Minnesota. 
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Because Minnesota schools are now more accountable to the public, they must find ways for students to 
succeed. The premise of the accountability movement is that if you hold people accountable, they will change 
their practices and policies in order to improve outcomes. Before discussing the specifics of this study, 
however, I will provide some background information regarding externally-mandated, high-stakes tests and 
educational accountability policies. 



Background 

Testing is sacrosanct in American education, at least for policymakers. “The caveats and reservations of many 
psychometricians have not been able to reduce the importance of the role assigned to testing by legislators 
and state board members...” (Madaus, 1985b, p. 611). The American public and policymakers see “...testing 
as an objective, scientific, and technological totem” (Madaus, 1985b, p. 615), and they do not question the use 
of testing “as an administrative mechanism to implement policy” (Madaus, 1985a, p. 5; see also Airasian, 1987; 
Madaus, 1985b). 

The role of testing programs has changed, however, since the late 1960s. No longer are testing programs 
used only for classroom-level diagnosis or even district-wide informational purposes; rather, standardized tests 
are increasingly being used in state or national policy “for lobbying within the sphere of policy making, rather 
than within the sphere of pedagogical practice” (Madaus, 1985b, p. 614). Madaus (1985b) states that “early 
tests were designed not to certify individuals or to make comparisons among school districts but to predict and 
select within local districts and schools, to identify individual learning needs, to group youngsters, and to 
compare local performance with national norms” (p. 612). Starting as early as the late 1960s, however, testing 
began to be used for a variety of policy-oriented purposes (Airasian & Madaus, 1983; Baker, 1 989; Cibuika, 
1990; Madaus, 1985b; McDonnell, 1994a; Rothman, 1995), such as: “assessing educational equity; providing 
evidence on school and program effectiveness; allocating compensatory funds to school districts; evaluating 
teacher effectiveness; accrediting school districts; classifying students for remediation; and certifying 
successful completion of high school ora given grade of elementary school" (Airasian & Madaus, 1983, p. 103; 
see also Rothman, 1 995). [For a more detailed analysis of the historical reasons for why this shift in 
assessment policy occurred, see Madaus (1985b), Madaus and Kellaghan (1992), Perrone (1979), Rothman 
(1995), or Resnick (1980).] 

Note that this shift in the way tests are used has also resulted in a shift over who controls the testing program. 
Although many schools may still have internal testing programs (i.e., testing programs that are mandated by 
the school principal or the district superintendent), just as many schools are also subject to externally- 
mandated testing programs. Madaus (1988) defines external testing programs as testing programs that are 
controlled by and/or mandated by outside authorities, such as state legislatures or state departments of 
education. Another common feature of externally-mandated testing programs is that important decisions are 
made based on the results of these tests, making these tests “high-stakes” (Woolfblk, 1993; see also Cohen & 
Spillane, 1992; Corbett & Wilson, 1991). Note that “a test can be considered high stakes if the results of the 
test have perceived or real consequences for students, staff, or schools” (Langenfeld, Thurlow, & Scott, 1 997, 
p. 1 ; see also Corbett & Wilson, 1991; Madaus, 1 988; Madaus & Kellaghan, 1 992). For example, test scores 
are used to track students into ability groups; to determine whether a child is ready to start school; to decide 
who should be promoted or retained in a grade or can graduate from high school; and to compare the quality of 
education in the U.S. versus another country or the quality of education among states or school districts 
(Dariing-Hammond, 1991, 1995; Madaus & Pullin, 1991; National Commission on Testing and Public Policy, 
1990; Neill & Medina, 1989; Nelson, Carlson, & Palonsky, 1996; Woolfolk, 1993). 

The Accountability Function of Externally-Mandated, High-Stakes Testing Programs 

McDonnell (1994a) argues that these externally-mandated, high-stakes testing programs serve an 
accountability (or regulatory) function. Throughout the 1980s and 1990s, the public voiced concern over 
accountability issues (i.e., the public wanted to know whether they were getting their money’s worth from public 
education and that certain standards were being upheld). In order to meet these public demands for 
AV untability, policymakers looked to standardized tests as one way to implement accountability policies. 
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The accountability function of assessment policy includes using tests (1 ) to demonstrate that students have 
attained an agreed-upon level of knowledge or mastered a set of standards (e.g., certification tests); or (2) to 
hold schools, teachers, and administrators accountable to the public for student performance on the test. 
Accountability is defined as “the systematic collection, analysis and use of information to hold schools, 
educators and others responsible for student performance” (Education Commission of the States, 1998, p. v; 
see also Bemauer & Cress, 1997). The underlying assumptions of the accountability function are as follows: 

Schools should be held accountable to the public, and rewards and sanctions are a mechanism for 
ensuring greater accountability. Improved student achievement is a critical component of accountability. 
Assessments can measure achievement consistent with public expectations, provide a guide for how 
teaching should change, and serve as the basis for distributing rewards and sanctions. Material incentives 
wiH motivate educators to change their teaching to be consistent with the assessment. Greater 
accountability will lead to changed teaching and, hence, to improved student achievement. (McDonnell, 
1994a, p.412) 

Thus, the reliance on the accountability function of assessment policy stems in part from the belief of many 
policymakers and proponents of high-stakes testing that rewards, sanctions, or some type of consequence are 
necessary to stimulate action or motivation on the part of students, teachers, administrators, or schools 
(McLaughlin, 1 991 ). In terms of students, for example, Madaus (1991; see also 1 985b) states that “fear of a 
low score on a certification test is intended to motivate a target population of lazy, recalcitrant, or otherwise 
unmotivated students to work hard” (p. 228). 

In terms of schools, the organizational theorist Mintzberg (1983, as cited in Corbett & Wilson, 1991) daims that 
organizations often turn to an outcome-oriented framework to stimulate action or change within the 
organization. Externally-mandated testing programs have been instituted to “generate school reform activity at 
the local level. By holding local educators accountable for clearly defined student outcomes, the expressed 
hope is that school district operations will change and become associated with ever-improving student 
learning” (Corbett & Wilson, 1991, p. 1). In essence, policymakers want instruction to improve at the local 
level, but they have no direct way of influendng what happens in the dassroom. Thus, one way that 
policymakers and other stakeholders influence the educational system is by adopting externally-mandated, 
high-stakes testing programs that are coupled with rewards or sanctions (Haertel, 1989; Madaus, 1985b; 
Madaus & Kellaghan, 1992). 

Translating the Premise of the Accountability Movement Into a Theory of Action 

One can translate the “premise of the accountability movement” into a model of what people (policymakers, the 
general public, and so forth) believe will happen when an externally-mandated, high-stakes testing policy is 
adopted. In the evaluation literature, these types of models have been called the program’s (or policy’s, in this 
case) theory of adion (Patton, 1997; Weiss, 1997). 

A theory of adion may be implicit (assumed) or explicit (specifically stated). This theory of adion identifies a 
sequence of events and the antidpated effect. Patton (1997) defines a theory of action as “the full chain of 
objectives that links inputs to activities, activities to immediate outputs, immediate outputs to intermediate 
outcomes, and intermediate outcomes to ultimate goals’ (p. 218); that is, it is “a means-ends hierarchical chain 
of objedives” (p. 1 53). The theory of adion specifies the series of assumptions that underlie a program or 
policy in terms of the causal mechanisms that explain how a policy is intended to work. Every step of the 
theory of action provides an opportunity for evaluation. However, before specifying a theory of adion for this 
study, I will present some of the assumptions commonly held for educational accountability systems — 
specifically, assessment-based educational accountability systems. 

Background on assessment-based educational accountability systems. Policymakers and proponents of 
testing programs use a number of interrelated arguments for instituting assessment policies; these arguments 
)VV the basis for developing the theory of action. The following statement by Lieberman (1991 ; see also Linn, 
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1993) touches on several of these reasons (note that although Lieberman is addressing the proposal of a 
national test put forth in the early 1990s, similar arguments are used by states when instituting externally- 
mandated, high-stakes assessment policies): 

Underlying the proposal for national testing are the assumptions that uniform tests will improve the 
education system as a whole, that instruction will necessarily improve as a result, and that teachers and 
students will benefit. The tests are supposed to measure the most important outcomes of schooling — 
those for which the education system should be held accountable — while providing direction and 
motivation for teachers and students. They will become the standard by which the public can measure 
success or failure, (p. 219) 

By dissecting the above quote, one can see that testing policy is being advocated as a source of motivation for 
tea c her s a n d st uden ts, as an accountability mechanism to the public, as a way to determine desirable 
outcomes of schooling, as a way to demonstrate that students have attained an agreed upon level of 
knowledge or mastered a set of standards, and so forth. Note that a particular educational accountability 
system may serve one or several of the purposes listed above (Claycomb, Kysilko, & Roach, 1997); however, 
“in a standards-based accountability system, the most obvious purpose is to monitor, evaluate and publicly 
report the progress of students, schools and districts toward achievement of content standards and xrther 
established goals? (Education Commission of the States, 1998, p. 10, italics in original). 

By imposing some consequence in connection with test results, the theory is that attention to the externally 
mandated standards will increase, ineffective practices will be identified and rectified, and student achievement 
wifl ifrcfease (Stecher, Barron, Kaganoff, & -Goodwin, 1998; eee also Rothman, 1995). The test ts seen as tire 
impetus for change, and schools can (and must, because of the accountability component) accept the 
challenge to use the test as an impetus for change in order to improve learning (and outcomes). The hope is 
that the likelihood of good practices occurring for students will increase and the likelihood of harmful practices 
for students will decrease. 



Some examples . Stecher & Barron (1 999) propose a model (or theory of action) of a test-based state 
accountability system. In their model, the state testing policy, which includes a testing program component 
and a standards component, is hypothesized to impact student outcomes (i.e., their knowledge, skills, and 
attitudes), classroom practices (such as student grouping, instruction techniques, and curricular decisions), 
and school policies (such as selection of curriculum, professional development). They explain that: 

Schools provide the educational services that help students achieve the desired goals. School 
administrators set local policies and teachers implement specific classroom practices to promote student 
achievement. As a result of their classroom experiences, students acquire knowledge, master skills and 
develop attitudes toward learning. These student outcomes are compared to the standards iset by the 
state testing policy — in Minnesota’s case, minimum competency in math and reading] to determine 
whether schools have been successful. Information about school performance is reported to the schools 
and to the g ene ra l public. Schools enact tfranges based on these lepoits to improve tire services they 
provide and enhance student outcomes, (no pages given) 



Chapman (November 10, 1998, personal discussion) outlined another theory of action that could be associated 
with the high-stakes testing, accountability movement. In his theory, the ultimate goal is improved student 
performance, and poticymakers (arid other adopuinj oirtsxwinany-maiTucjwsu, iftyii- 

stakes testing policy will stimulate certain actions on the part of schools, educators, and the public. For 

evamrile tha focfinn onlirv will laari fn a ch&nty* in what La iaunbt in school /Pi the instnj.ctinnal .st/ateoies 

used, (3) the motivation level of students and teachers, and (4) the public’s attention to educational matters. 

Common features of assessment-based educational accountability theories of action. The theories of action 
assouausu wiui iiie assessi i rehi-uaseu euucauunai occuuiuauimy movement have seveiai leaunea m 



/vimmnrv 




/1i a mimnsa/si nr ultimata nnal/sV (0\ an intan/antinn - anrl hvnnthasfcraH maana fnr arhiavinn 

.e., the processes and activities that are theorized to occur as a result of the intervention, which 

6 



In-Depth Investigation of Responses to MBST 6 



should then lead to the ultimate goal). Common goals include increasing student achievement (or some 
variation on that theme, such as improving student outcomes) and holding schools and districts accountable. 

In these models, adopting an externally-mandated, high-stakes testing policy is seen as the “intervention” that 
will stimulate people to do what is needed (i.e., the hypothesized processes and activities) to achieve the 
ultimate goal(s). 

The Proposed Model 

As mentioned above, one component of Minnesota’s results-oriented graduation rule focuses on basic 
standards, which define the minimum competency in reading and mathematics that a student must possess 
before graduating from a Minnesota public high school. The purpose (or ultimate) goal of the minimum 
competency requirement is twofold: (1) to hold students, schools, and districts accountable; and (2) to improve 
student achievement (at least to some minimum level) in the areas of reading and math. The “intervention” is 
the minimum competency testing policy [the status of goal achievement will be measured by performance on 
the Minnesota Basic Standards Test (MBST)]. 

Although there are a variety of levels at which the above model could be developed, what was of interest in this 
study was the link between Minnesota’s externally-mandated, high-stakes testing policy and improved student 
achievement; that is, what would happen at the school- and district-level as a result of this policy that would 
lead to the ultimate goal of improved student achievement (as measured by test performance on the MBST)? 
[Note that one could also develop the model at the state-level, the classroom-level, the student-level, and so 
forth. One could also look at inputs or outcomes rather than processes (i.e., activities or actions).] The list of 
activities (processes) that the “intervention” is hypothesized to stimulate was developed based on a review of 
the literature (Claycomb, Kysilko, & Roach, 1997; College of Education and Human Development, 1996; 
Education Commission of the States, 1998; Madaus, 1985b; McDonnell, 1994b; Popham, 1987; Stecher, 
Barron, Kaganoff, & Goodwin, 1998); however, because I conducted a qualitative study using a semi- 
structured interview protocol (described below), the “discovery” of additional processes to add to the model is 
also possible. 

Figure 1 shows the theory of action that was developed for this study, which examined the adoption and 
implementation of the testing policy at the school- and district-level. 



Insert Figure 1 here 



In this model, it is hypothesized that in order to meet the ultimate goal of improved student achievement in the 
areas of reading and math, the following things will happen as a result of the testing policy; that is, the adoption 
and implementation of the testing policy will: 

• help schools identify students who may otherwise have “slipped through the cracks"; 

• force schools to offer a variety of services for students who need remedial work (i.e., they are at-risk 
of not passing or have not passed the MBST); 

• bring greater curricular coherence to the system; and 

• provide information for program/school improvement. 

Study Rationale and Research Question 

This theory of action articulates what people expect will happen as a result of adopting an externally- 
mandated, high-stakes testing program; however, the Summer 1998 issue of Educational Measurement: 
Issues and Practice highlights the importance and necessity of documenting what actually happens as a result 
of the adoption of an externally-mandated, high-stakes testing program (e.g., Yen, 1998). The goal of carefully 
documenting what happens in schools as a result of the adoption of a new testing program “is to develop 
specific concrete examples that will enhance our understanding about the ways in which tests can and do work 
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in local contexts and about the potential slippage between what we well-meaningly intend and what we in fact 
effect” (Moss, 1998, p. 11). 

This study investigated the school-level and district-level changes in policies and practices as a result of the 
adoption and implementation of an externally-mandated, high-stakes testing program in the state of Minnesota. 
The primary research question was the following: “What are the school-level and district-level responses to the 
implementation of an externally-mandated, high-stakes testing program in the state of Minnesota?” Fitting the 
information obtained in the study into the theory of action proposed in Figure 1 allows us to investigate whether 
the assumptions about what will occur in schools and districts are warranted. 

Methodology 

Although the main purpose of this study was to provide an in-depth look at one school district’s responses to 
an externally-mandated, high-stakes testing policy, this study also served as a pilot study to help determine the 
most efficient means of gathering similar information from schools throughout the state of Minnesota (still to be 
determined). Thus, the information presented in this paper comes from only one school district. An advantage 
of using only one school district is that the context in which change is occurring at the school-level will be more 
consistent than if I had sampled school sites from a variety of school districts. 

The Site Context 

The school district used for this study serves several communities and is considered a suburban school district 
in the state of Minnesota. The district serves approximately 14,000 students, and has 3 high schools, 4 middle 
schools, and 12 elementary schools. Note, however, that this study focused on middle schools and high 
schools only. Because the MBST is first administered to students in 8 th grade, the middle schools and high 
schools would be most likely to change in response to the MBST (at least in the first years of implementation of 
this new testing policy). 

The Interview Instrument and Respondent Information 

In order to gain an in-depth understanding of this district’s responses to the MBST, a qualitative methodology 
was used. Qualitative methods provide a rich, holistic description and analysis of a phenomenon. Interviews 
were chosen as the data collection method because they are useful for obtaining information that cannot be 
directly observed and for finding out “what is ‘in and on someone’s mind” (Merriam, 1988, p. 72). Because I 
did not want to limit the production of ideas from the interviewees, an open-ended, semi-structured interview 
protocol was used. Patton (1 987) states that “the fundamental principle of qualitative interviewing is to provide 
a framework within which respondents can express their own understandings in their own terms” (p. 142). 

Also, Patton (1987) states that “interviews are a source of meaning and elaboration for program observations” 
(p. 109), which is precisely the type of information necessary for this study. 

The sample was purposive and included key people at both the district- and school-level. Key people were 
those people who could provide detailed information about the school-level and district-level changes taking 
place as a result of the MBST. At the district level, I interviewed key people in the following areas: teaching 
and learning, district curriculum specialists, limited English proficiency, special education, student 
services/minority populations, and research and evaluation. At the school level, I interviewed principals, 
counselors, and/or teachers (this varied by site). 

The focus of the study included: (1 ) interviewees’ perceptions of how the district or schools had changed since 
the introduction of the Minnesota Basic Standards Test (MBST); (2) current and/or future responses (or 
changes) made as a result of the MBST; and (3) needs at the building and/or district level. 

Interviewees were asked about the specific responses that have occurred in their district or their schools. For 
example, they were asked about changes in school-day and school-year restructuring efforts (e.g., adding 
- . -school or summer school programs), changes in school organization and administrative practices (e.g., 
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changes in course offerings, altering of student placement policies), and remediation opportunities. For each 
specific response mentioned, follow-up questions were asked in order to gain further understanding of the 
response, such as (1) what remediation opportunities are offered? (2) who qualifies for those opportunities? (3) 
how are students selected for remediation opportunities? and (4) when is remediation provided (i.e., during 
regular school hours, in after-school or summer school programs)?. 

Data Analysis 

This study was conducted for two different purposes. From an educational policy perspective, it is important to 
document what schools and districts are doing to improve results (as discussed above). From a district 
perspective, it is important to document what is being done because of concerns over “opportunity to leam” 
issues and for district or school planning purposes. 

For each school or district department, the data were summarized on a variety of dimensions, which included: 

• general information about a program or school; 

• responses specific to the subjects areas of reading, mathematics, and writing; 

• summer school, after-school, or tutoring opportunities; 

• communication to parents; 

• staff development; 

• tools or assessments used; and 

• identified needs. 

Each school and district department received a copy of the matrix developed for that specific school or area; 
they also received the matrices developed for all other schools and district departments. I developed a list of 
general findings based on the information contained in the matrices and comments made by interviewees. I 
present a summary of the matrices and general findings in the next section. 

Findings 

Part of conducting a “good” qualitative study is sorting through the multitude of data obtained and organizing it 
in such a way as to be useful and meaningful for your audience. Clearly, summary tables of all of the 
responses for each school and district department were useful and meaningful for the school district, especially 
for “opportunity to leam“ reporting. However, reporting the information in these same tables to an audience 
more interested in the implications of a policy for schools, districts, and their administrators would certainly be 
less meaningful to that audience. Thus, I am going to combine the “results” and “interpretation” sections, in 
order to try to make the findings more meaningful. 

The theory of action presented above is a useful framework within which to consider the responses of this 
school district to Minnesota’s externally-mandated, high-stakes testing policy. Fitting the information obtained 
in the study into the theory of action proposed in Figure 1 allows us to investigate whether the assumptions 
about what will occur in schools and districts are warranted. That is, using the information obtained here, we 
can analyze what actually happens in schools versus what was expected to happen, based on the theory of 
action. 

Testing Policy Helps Schools Identify Students Having Trouble in Reading and/or Math 

In general, the educators in this district felt that one of the most positive aspects of the adoption and 
implementation of Minnesota’s basic standards testing policy is that it has served to highlight the needs of 
some students, who otherwise may have “slipped through the cracks.” Although some of the educators 
interviewed had been concerned about these at-risk students all along, they attributed the increased attention 
that all educators were giving to the development of skills in these students to the adoption of the basic 
etonrjards testing policy. The LEP (limited English proficiency) coordinator told how “before this test the kids 
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could breeze through classes, get credits, and graduate with very minimal proficiency in English. 1 ’ He felt that 
with the adoption of the testing policy, which requires that LEP students pass the test, more attention was 
being paid on helping these students increase their reading and math proficiency. 

One principal commented that it has forced them to “look more at remediation than in years past.” He said 
they now “look at the skills students must have and design courses appropriately.” A middle school principal 
explained how his math and reading and language arts departments use the information from the district-level 
achievement test to “see where the holes are, the deficiencies and then work with those students in seventh 
and eighth grade.” One of the district administrators emphasized that there has been “an increased focus on 
reading and literacy in the elementary schools” and that “many elementary schools are adding reading 
specialists to their staff.” The district curriculum specialist in reading remarked that this policy has forced the 
district to focus on the needs of certain students, as well as on the importance of reading in general for all 
students. 

Testing Policy Forces Schools to Address Remediation Needs 

Stecher and Barron’s (1999) test-based accountability model suggests that schools will use information about 
school performance on the high-stakes test to make changes that will “improve the services they provide and 
enhance student outcomes” (no page given). Minnesota policymakers and the Minnesota Department of 
Children, Families and Learning state that “local districts offer a variety of services to students who do not pass 
the tests” (http://www.educ.state.mn.us) and that “the results of these tests can help school districts make 
decisions about what and how they teach” (http://www.educ.state.mn.us). These ideas were incorporated into 
the specific theory of action model proposed above; that is, the testing policy will force schools to offer a variety 
of services for students who need remedial work (i.e., they are at-risk of not passing or have not passed the 
MBST). 

Tables 1-4 show that the district, the high schools, and the middle schools have responded to the needs of 
students (particularly those students who have not passed the MBST or who are at risk of not passing the test 
in 8 th grade) in a variety of ways. 



Insert Tables 1-4 here 



Table 1 demonstrates the activity that was generated at the high school level in order to respond to the needs 
of students who have not passed the reading and/or math portions of the MBST. During the regular school 
day, students can practice math skills with a teacher in the math resource room or use a tutorial program 
available in the computer learning center. Remedial reading and math classes have also been developed. 

Table 2 provides a summary of the responses that the middle schools have made to the MBST. A site-based 
summer school offering student-specific remediation is available for students who have been identified as 
needing extra help in reading and/or math. Remedial reading classes are offered to seventh and eighth grade 
students; however, students who enroll in the remedial classes must then miss out on some other elective 
class (i.e., health, social studies, keyboarding, or a foreign language, depending on the grade-level of the 
student and the individual middle school). Although many of the responses at the middle school level are to 
support students at-risk of failing (i.e., students identified as needing remedial opportunities), the middle 
schools have increased their focus on the basic skills in reading and math for all students. For example, the 
middle schools are sponsoring book fairs several times a year, reading contests throughout the year, and so 
forth. 

Tables 3 and 4 show how the district math and reading curriculum departments have responded to the needs 
of students and teachers in the district. The district curriculum specialists describe their roles as “resource” 
people; that is, they do not dictate school and/or teacher practices, rather they offer information and support. 
For example, the district math curriculum specialist worked with other educators in the district to create 
readiness packages for students in grades 2-7 and remediation packages for students who have not passed 
:>w~est (see Table 3). These packages contain practice tests, worksheets, and useful math vocabulary. Math 
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resource notebooks have also been created for teachers that include the learner outcomes for each grade, 
research-based information on best practice, supplemental worksheets, and pretests. Table 4 shows that the 
district reading curriculum specialist has worked with middle and high school teachers to develop remedial 
courses (offered either during the school day or during summer school). 

The data obtained in this study indicate that the schools and district have largely utilized familiar models of 
student grouping (i.e., put all the students having trouble into one class and try to remediate them), remediation 
(“more of the same”), and test-preparation techniques (drill and skill, practice tests) — at least for the students 
at-risk of not passing the MBST. Many of the educators in this district expressed frustration over the need for 
more information about “best practices” regarding, for example, how to teach reading to older students or to 
second language learners still struggling with reading. Several principals stated that they would like to hire 
more reading specialists who could provide staff development on how best to help older readers and second 
language learners, but they have found it very difficult to find people qualified for these positions. Several 
people were concerned that without this information on “best practices” in reading, the remedial classes may 
offer only “more of the same” approaches to remediation (which one could argue are not working, since the 
students are still struggling with reading at 7 th , 8 th , and 9 th grade). 

The educators acknowledged, however, that the pressure to help students pass the test (so that they can 
graduate from high school) makes it difficult to (feel that there is time to) try new, less researched techniques 
(not to mention the accountability pressure of test scores decreasing within the district). Stecher and Barron 
(1999) found that “given limited time and resources, schools often direct their attention more narrowly to 
practices that will enhance student performance on the tests. This is one way in which the discrepancy 
between broad goals and specific measures may reduce the effectiveness of a test-based accountability 
system” (no page numbers provided). The evidence in this pilot study suggests that contention; that is, 
although the tables clearly demonstrate that this district has responded with a large number of actions, many 
wish that these actions were coupled with more information on “best practices.” 



Testing Policy Brings Greater Curricular Coherence to the System 

In both reading and mathematics, the district has taken steps to bring greater curricular coherence to the 
system. Table 3 shows that the district has adopted a new math curriculum for the middle schools and high 
schools. This new curriculum “reinforces the eight strands of the MBST math portion"; thus, the district math 
curriculum is not only aligned from middle school to high school, but it is also aligned with the state test. Table 
4 shows that the district has adopted a new K-6 reading series that all elementary schools began using in the 
fall of 1999. Although there is now greater curricular coherence in the system, one middle school principal felt 
that even more should be done to create common curricula and instructional practices within the district. This 
particular principal believes that “site-based decision-making has made things too horizontal’ and that 80% of 
what is done should be common across schools. Others commented on the need to continue working on K-12 
alignment of the curriculum. 

One area in which the educators in this district felt that more discussions were needed regarding curricular 
coherence was at the intersection of mainstream, LEP, and special education curriculum, particularly with 
regard to remedial coursework. The mainstream perspective on remedial classes is that the LEP and special 
education students would receive remediation in their special education or LEP classes and, thus, would not 
need to be included in mainstream remedial classes. The special education and LEP perspective is that the 
money and decisions are in the hands of mainstream educators, and yet their students do need to be included 
in “mainstream” remedial classes; thus, these groups often felt left out of the discussions about remedial 
opportunities. 



Testing Policy Stimulates the Use of Information for Program/School Improvement 

The Minnesota Department of Children, Families and Learning states that the test results will be used to 
“generate information for school improvement.” As one educator noted, Minnesota’s testing policy does force 

r cts to “look at student achievement.” “We need to know that our students are achieving at a certain level; 
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students need to graduate with at least those competencies measured by the test.” Thus, the testing policy 
“has dear implications for building improvement plans.” In fad, the district’s strategic plan was described as “a 
tool that creates alignment between teacher plans and building plans, building plans and distrid plans, distrid 
plans and state plans... to develop a strategic plan at any level, one must specify the following components: 
goals (i.e., what do you want to accomplish?), indicators of goal accomplishment, and ways in which the distrid 
can provide support." 

The Minnesota Department of Children, Families and Learning also states that the test results will “allow for 
identification of programming and strategies that work.” However, the prindpals in this distrid recognized a 
need for improved uses of data to inform dedsions. They still found themselves responding to the needs 
versus using data to plan interventions. They were not using data to determine which interventions were 
working (or not) or which ones were working for some students and not for others. The educators expressed 
the desire to use data to determine skill areas where students are lacking so that they could design appropriate 
courses and interventions and use data to determine which interventions are working; however, they did not 
feel that they had the knowledge or capacity to do that (yet). Thus, although CFL claims that districts and 
schools will use the information from the tests to make changes and plan interventions, it may not be the case 
that schools are able to do that effectively. The district research, evaluation and assessment specialist in this 
district is trying to help schools use data— Table 5 dearly shows that this school district is trying to help its 
prindpals and teachers use data to make programming decisions at the individual student level, as well as at 
the building level. 



Insert Table 5 here 



In summary, the types of activities and processes happening at the school- and distrid-level fit the types of 
activities and processes that were expected, according to the theory of action model, to happen at the school- 
and distrid-levels as a result of Minnesota's externally-mandated, high-stakes testing policy. However, it is 
important to note that another assumption of most accountability models is that schods and districts have the 
technology, resources, and people to make necessary changes. What is evident from this study is that the 
schools and distrid are making the changes for which they have the technology, resources, and people, but 
have noted the types of changes they would like to make — given access to different, or more, technology, 
resources, and people. 

Conclusions 

Hargreaves (as cited in Wells, Hirshberg, Lipton, & Oakes, 1995) notes that studies usually have a defined unit 
of analysis and tend to consider either the macro or micro view. Hargreaves “calls upon educational 
researchers to focus on the middle range between the ethnographic study of dassrooms and the large macro- 
or sodetal-level research and theory” (p. 21); thus, we do need more research on the processes at the middle 
range, such as studies that focus on the school-level, as this study did. 

Studies are also needed that follow a macro policy through to its micro implementation, so that we can better 
understand what happens at all levels of implementation. By carefully delineating the theory of action at the 
policy-setting level (i.e., the macro level) in terms of what is expected to happen at the implementation level, it 
would be possible to investigate what actually happens for each component of that theory of action at the 
implementation-level. One advantage of examining both the macro and micro level in one study is that 
discrepandes between these levels could be highlighted. For example, in this study, the educators at the 
micro level stated a need for more reading spedalists with knowledge of “best practices’ as a result of the 
macro-level state testing policy; however, the state is currently revising the skill and knowledge requirements 
for reading licensure in the state and they are decreasing the requirements. This also suggests that examining 
the interaction of a variety of policy initiatives and their affect on the system is important, because this could, 
for example, create a tension at the implementation level between two macro-level policy initiatives. 
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Figure 1 

School-Level Theory of Action for Minnesota’s Externally-Mandated, High-Stakes Testing Policy 
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Table 1 

Summary of One School District’s Responses to the MBST at High School A 
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Table 2 

Summary of One School District’s Responses to the MBST at Middle School B 
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Table 3 

Summary of Responses to the MBST at the District Level for Mathematics in One District 
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Table 4 

Summary of Responses to the MBST at the District Level for Reading in One District 
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